A Fast Method for Textual Annotation of Compressed Video

We present a method for automatic textual annotation of compressed video. Initially, cuts are detected in the video sequence where consecutive frames show a large difference. Key frames are then extracted to represent each shot. A video sequence is, thus, condensed into a few images, hence this forms a compact key frame representation of the video. Each key frame is compared with an annotated database of images, using standard CBIR techniques, to obtain a textual description of the scene. The entire process is designed to work on MPEG-DC sequences, where only a partial decoding is required for performing content-based operations on MPEG compressed video streams.